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SYSTEMS AND METHODS FOR INSPECTING 
NATURAL OR MANUFACTURED PRODUCTS 

CROSS REFERENCE TO RELATED APPLICATIONS 

5 This application claims the benefit of U.S. provisional patent application serial 

number 60/440,191, filed January 15, 2003, which is incorporated herein by reference in 
its entirety. 

FIELD OF THE INVENTION 

1 0 The present disclosure relates generally to natural products and, more particularly, 

to systems and methods for inspecting food products. 

BACKGROUND 

Inspection and grading of food products, such as grapefi-uit, tomatoes, poultry, etc, 
15 are labor-intensive tasks. Typically, these labor-intensive tasks require visual inspection 
of the food products to determine whether or not the food products possess any desirable, 
undesirable, or unacceptable defects. Often, the process involves a subjective evaluation 
of the food products by quality-control personnel. The subjective evaluation results in a 
great variance w^ithin the range of the food products that are considered acceptable with in 
20 the industry. 

Due to these variances resulting firom the subjectivity of the evaluator, as well as 
the difficulty of conducting these operations at line rates for extended periods of time, the 
industry has sought to automate the implementation of the inspection and grading 
process. However, the task of grading non-uniform objects is nontrivial. Thus, despite 
25 the various mechanized processes available for automatically sorting food products, there 
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is still a need in the industry for a better system and method for inspecting and grading 
food products. 

SUMMARY 

5 The present disclosure provides systems and methods for inspecting food 

products. 

In a broad sense, the several embodiments presented herein utilize a process in 
which contrast data is generated as a function of reference data and acquired sample data. 
The contrast data has contrast features, which represent deviations between the sample 
10 data and the reference data. The contrast data is used to determine an acceptability level 
of the sample product. 

While example embodiments are disclosed herein, it should be appreciated that 
the invention is not limited only to the disclosed embodiments. To the contrary, other 
systems, methods, features, and advantages are intended to be included within this 
15 description, as would be appreciated by those having skill in the art. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Many aspects of the disclosure can be better understood with reference to the 
following drawings. The components in the drawings are not necessarily to scale, 
20 emphasis instead being placed upon clearly illustrating the principles of the present 

invention. Moreover, in the drawings, like reference numerals designate corresponding 
parts throughout the several views. 

FIG. 1 is a diagram showing an example setup for acquiring images of spherical 
samples. 
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FIG. 2 is a block diagram showing equipment for processing images acquired 
using the setup of FIG. 1. 

FIG. 3 is a block diagram showing component architecture of a client computer 
from FIG. 2. 

FIG. 4 is a flowchart showing a process for inspecting products. 
FIG. 5 is a flowchart showing the sample-locating step of FIG. 4 in greater detail. 
FIG. 6 is a flowchart showing the contrast-image-generating step of FIG. 4 in 
greater detail. 

FIG. 7 is a flowchart showing the evaluating step of FIG. 4 in greater detail. 
FIG. 8 is a flowchart showing the pixel subtraction step of FIG. 6 in greater detail. 
FIG. 9 is a block diagram showing an example setup for acquiring relatively 
planar samples. 

FIG. 10 is a flowchart showing another process for inspecting products. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

While several embodiments are described in connection with these drawings, 
there is no intent to limit the invention to the embodiment or embodiments disclosed 
herein. On the contrary, the intent is to cover all altematives, modifications, and 
equivalents. 

In general, studies have shown that, in operation, the human visual cortex 

distinguishes objects by detecting contrast. In this regard, when visible defects (or other 

visible discrepancies or variants) are present in certain objects, those variants are detected 

in human vision by observing the contrast between the normal portion of the object and 

the defective portion of the object. Since the defective portion displays a visual 

appearance that is different from the normal portion, a contrast is generally present at the 
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boundary between the normal portion and the defective portion. Studies have shown that 
these contrasts facilitate the detection of defects. 

The disclosed systems and methods show that greater accuracy, consistency, and 
robustness are obtainable when such contrast features form the basis for machine- vision- 
5 based defect detection. For example, in mechanical or automatic sorting of grapefruits, 
the use of contrast-based images improves the accuracy and reliability of the inspection 
and sorting process. Similarly, in automatic defect detection in chicken breasts, the 
employment of contrast features provides greater accuracy and reliability. Additionally, 
in sorting any product that exhibits inter-product and intra-product heterogeneity, the 

10 analysis performed on the contrast image results in more robust data processing despite 
the relative gain in computational burden due to the generation of a contrast image (or 
contrast-based image). Unlike systems that acquire reference images and calculate 
acceptance or rejection criteria from the reference images, the disclosed system and 
method generate a contrast image from acquired reference images and sample images. 

15 Thereafter, acceptance and rejection criteria are calculated from the contrast images. 
Hence, unlike other approaches that utilize a reference image, the disclosed approach 
performs a bulk of the processing in the "contrast space," rather than "normal space." 

FIGS. 1 through 10 describe several embodiments of systems and methods that 
may be employed to generate contrast-based images and analyze those contrast-based 

20 images for detecting defects in heterogeneous products. It should be appreciated that, 

while grapeftnits and chicken breasts are used to specifically illustrate products exhibiting 
inter-product heterogeneity and intra-product heterogeneity, the systems and methods 
disclosed herein may be employed in defect detection for any product (natural or 
synthetic) that displays inter- and intra-product heterogeneity. 
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FIG. 1 is a diagram showing an example setup 100 for acquiring images of 
spherical samples. For example, the setup 100 may be used to acquire images of oranges, 
grapefruits, or other spherical food products. In fact, it should be appreciated that the 
setup 100, while conducive to acquiring images of spherical objects, may further be used 
5 to acquire full surface images of any three-dimensional object. As shown in FIG. 1, the 
setup 100 divides the spherical object into eight octants 1 15, 125, 135, 145, 155, 165, 
175, 185. A camera 110, 120, 130, 140, 150, 160, 170, 1 80 is positioned in front of each 
respective octant 115, 125, 135, 145, 155, 165, 175, 185, thereby permitting image 
acquisition of each octant 115, 125, 135, 145, 155, 165, 175, 185 by its corresponding 

10 camera 110, 120, 130, 140, 150, 160, 170, 180. Since the image from each of the eight 
octants overlaps with portions of the image from adjacent octants, a combination of all 
eight acquired images is typically sufficient to construct a surface projection of the entire 
three-dimensional object. 

FIG. 2 is a block diagram showing equipment associated with several 

15 embodiments for processing images acquired using the setup 100 of FIG. 1. Since images 
are acquired for eight octants 115, 125, 135, 145, 155, 165, 175, 185, the image 
acquisition equipment includes each of the eight cameras 1 10, 120, 130, 140, 150, 160, 
170, 180 that are configured to acquire the image from each of their corresponding 
octants. The image processing hardware includes a conveyor encoder 230, four client 

20 computers 205, 210, 215, 220, an Ethernet hub 225, a server computer 235, a user 

interface 240, and a standard (STD) bus computer having a program 245 that is 

responsible for controlling a mechanical sorter 250. 

The conveyer encoder 230 is operatively coupled to the four client computers 205, 

210, 215, 220. The cUent computers 205, 210, 215, 220 are triggered by the conveyor 

25 encoder 230 as the sample moves within imaging range of the eight cameras 110, 120, 
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130, 140, 150, 160, 170, 180. The triggering by the conveyor 230 permits image 
acquisition of the eight octants of the sample. Each of the eight cameras 110, 120, 130, 
140, 150, 160, 170, 180 are operatively coupled to at least one of the four chant 
computers 205, 210, 215, 220. The cUent computers 205, 210, 215, 220 control the 

5 operation of the eight cameras 1 10, 120, 130, 140, 150, 160, 170, 180. Thus, the cHent 
computers control image acquisition by each of the cameras. Additionally, the coupling 
of the cameras to the client computers permits transfer of acquired images from the 
cameras to the client computers. In an example embodiment, each of the four client 
computers 206, 210, 215, 220 is configured to receive the acquired images from two of 

10 the eight cameras 1 10, 120, 130, 140, 150, 160, 170, 180 as shown in FIG. 2. 

Once the acquired images are transferred to the client computers 205, 210, 215, 
220, each of the client computers generates regions of interest (ROI) that are associated 
with their respective octants, and the ROIs are subsequently used to grade or sort samples. 
Once the client computers 205, 210, 215, 220 have graded or sorted the samples, the 

15 results obtained from each of the client computers is then transmitted to the server 

computer 235 over the Ethernet hub 225. Upon receiving the results from each of the 
client computers 205, 210, 215, 220, the server computer 235 aggregates the results and 
performs a final grading or sorting of the samples based on the aggregate of the results. 
Greater details related to the grading or sorting of the samples are provided with 

20 reference to FIGS. 4 through 8. It should be appreciated that, while eight cameras and 

four client computers are shown with reference to FIG. 2, the number of cameras and 

number of client computers need not be fixed to eight and four, respectively. Rather, the 

number of cameras and client computers may be varied to concomitantly vary the 

processing performance that may be required of the system. Additionally, it should be 

25 appreciated that a single computer may be used in place of the client-server architecture 
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shown in the embodiment of FIG. 2. One such embodiment is shown in greater detail 
with reference to FIG. 9. 

FIG. 3 is a block diagram showing component architecture of a cUent computer 
210 from FIG. 2. While the architecture of only one client computer is shown in FIG. 3, 
5 it should be appreciated that each of the client computers 205, 210, 215, 220 of FIG. 2 
may have similar component architectiu-es. As shown in FIG. 3, the client computer 
comprises a processor 310, memory 330, a network interface 350, and a hardware 
interface 360, which are all interconnected through a local bus 320. The hardware 
interface 360 is adapted to interface extemal components, such as a display device 370, to 

10 the bus 320. The network interface 350 is adapted to interface the client computer 210 to 
the Ethernet hub 225 as shown in FIG. 2. The embodiment of FIG. 3 shows the memory 
330 being configured with image acquisition logic 332, ROI generation logic 334, 
contrast image generation logic 336, lookup tables 338, and image evaluation logic 340. 
In several embodiments, these logic components 332, 334, 336, 338, 340 may be specific 

15 computer codes that instruct the processor 310 to carry out fimctions such as image 
acquisition, ROI generation, contrast image generation, image evaluation, etc. As is 
known in the art, the memory 330 may be either volatile memory or non-volatile memory 
or a combination of both. While certain imaging applications are specifically shown with 
reference to FIG. 3, it should be appreciated that the client computer 210 may be adapted 

20 for additional fimctions, such as the execution of other software (not shown). 

FIG. 4 is a flowchart showing a process for inspecting food products, which may 

be performed by the system shown in FIGS. 1 through 3. As shown in FIG. 4, one 

embodiment begins with the step of storing (410) reference images associated with 

varying sample sizes. In several embodiments, the reference images are red-green-blue 

25 (RGB) images that have the red-, green-, and blue-color components that comprise 
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standard color images. In this regard, each pixel in the color image may have three 
component values associated with each of the component colors. 

If the system is adapted to image grapefruits, then each of the reference images 
may depict an idealized image of a grapefruit. Thus, for example, each reference image 

5 may represent a grapefruit of a different size. Since the reference images depict an 
idealized image of the sample, for grapefruits, the reference image may be images of 
round balls having a yellowish-orange hue similar to that of a healthy grapefruit. 

Once the reference images have been stored (410), the system acquires (420) 
sample images. If the setup 100 of FIGS. 1 through 3 is used, then the sample is 

10 transported to the imaging field of view (FOV) by a conveyer system. When the sample 
reaches the appropriate location in the conveyer system (e.g., within the operative field of 
the cameras), the cameras acquire images of the eight octants of the sample. In the 
example of grapefiniits, each of the eight cameras would acquire images of the grapefruit 
from eight different angles, each of the eight different angles corresponding to one of the 

15 eight octants. In several embodiments, the acquired (420) images are RGB images, 
thereby permitting color comparisons to the stored (410) reference images. 

Upon acquiring (420) the images, the sample is located (430) within the image. 
Thus, for grapefruits, the imaging system determines the location of the grapefiiiit from 
within the image. Embodiments of the sample-locating step (430) are provided and 

20 discussed in greater detail with reference to FIG. 5. Once the sample is located (430), the 

size of the sample is determined (440). Again, for grapefruits, the proper size of the 

grapefiiiit is determined (440) from the located image. Upon determining (440) the size 

of the sample, the system selects (450) a reference image that corresponds to the 

determined size of the sample. For grapefruits, the system would select (450) the 

25 reference image of the ball that best corresponds to the size of the sample grapefruit. 
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After selecting (450) the appropriate reference image, the system generates (460) 
a region of interest (ROI) for evaluation. In embodiments where images of octants are 
acquired, the ROIs are generated (460) such that there is minimal overlap between the 
imaged areas of each octant. For example, since each camera effectively acquires an 
5 image of the entire hemisphere of a grapefinit, images from adjacent octants would 

necessarily include areas that are covered by other cameras. Thus, a simple aggregate of 
all acquired images results in duplicative coverage of several areas of the grapefruit. In 
order to avoid duplicative coverage and to provide sufficient coverage, each generated 
ROI would be adapted to satisfy two conditions. First, that each ROI would provide 

10 minimal overlapping coverage with adjacent ROIs. Second, that the aggregate of the 

ROIs would leave no area uncovered. In short, the ROIs would be selected such that the 
entire surface of the area of the grapefruit is imaged without duplicative coverage of any 
area. Thus, each ROI would include the surface area of its corresponding octant. 
The ROIs may be generated by manually masking each reference image. 

1 5 Alternatively, the ROIs may be generated by manually masking several of the reference 
images and utilizing iterative morphological processes, which are known in the art, to 
generate the ROIs for the remaining reference images. Regardless of how the ROIs are 
generated, it should be appreciated that the aggregate of the ROIs results in non- 
duplicative coverage of the entire surface area of the sample. 

20 Upon generating (460) the ROIs, a contrast image is generated (470) by 

subtracting the ROI of the sample image from the corresponding ROI of the reference 
image. Embodiments of the generation (470) of the contrast images are provided with 
reference to FIG. 6. The generated (470) contrast image is then evaluated (480) to detect 
defects in the sample. Embodiments of the evaluation (480) process are discussed in 

25 greater detail with reference to FIG. 7. 
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FIG. 5 is a flowchart showing the sample-locating step (430) of FIG. 4 in greater 
detail. As discussed with reference to FIG. 4, once the image is acquired (420), the 
system locates (430) the sample within the acquired image. For example, when imaging 
grapefruits, the sample typically occupies only a circular portion of the entire acquired 
5 image. Thus, processing each and every pixel within the acquired image would waste 
computing resources. In order to avoid such inefficiencies, the sample is located (430) 
within the acquired image. 

In several embodiments, the sample-locating step (430) begins with a selection 
(510) of a radial line from a set of radial lines. The radial lines emanate from the center 

10 of the acquired image to the edge of the acquired image. In this regard, each radial line 
traces a path between the center of the image to the periphery of the image. Once the 
radial line has been selected (510), a pixel located at the farthest point from the center of 
the image is selected (520). The selected pixel is evaluated to determine (530) if it is a 
sample pixel or a background pixel. Since, in example embodiments, each pixel has a 

1 5 red-, green-, and blue-color value (hereinafter "RGB value(s)"), these RGB values are 
evaluated to determine whether or not the pixel is a sample pixel. In example 
embodiments, acceptable RGB values are stored in a lookup table. Hence, if the pixel 
value deviates from the acceptable RGB values by a predefined amount, then the pixel is 
considered to be a non-sample pixel. On the other hand, if the pixel value does not 

20 deviate significantly from the acceptable RGB value in the lookup table, then the pixel is 

considered to be a sample pixel. 

If the evaluated pixel is determined to be a non-sample pixel, then the next 

farthest pixel along the radial line is selected (560) and the evaluation process is repeated. 

These steps are iteratively repeated until the selected pixel is determined to be a sample 

25 pixel. If the evaluated pixel is determined to be a sample pixel, then the system 
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determines (540) whether or not all radial lines have been evaluated. If all radial lines 
have not been evaluated, then the system selects (550) the next radial Une and repeats the 
iterative process of selecting (520, 560) and evaluating (530) the pixels along the selected 
(550) radial line. As seen from the process of FIG. 5, the evaluation of all radial lines 
5 provides information on the periphery of the sample. Thus, for grapefruits, the evaluation 
of all radial lines produces an approximately-circular locus of points that traces the outer 
periphery of the grapefruit. This information may also be used to determine the size of 
the sample. In this regard, the reference image that closely corresponds to the traced 
periphery is selected as the reference image that is used for the generation of the contrast 
10 images. 

FIG. 6 is a flowchart showing the contrast-image-generating step (470) of FIG. 4 
in greater detail. As shown in FIG. 6, the contrast image is generated (470) by selecting 
(610) the coordinate of the first pixel in the region of interest (ROI). Typically, the pixel 
coordinate is designated by a register address that is indicative of the pixel location. 

15 Since the same ROI is typically used for both the reference image and the sample image, 
the reference image and the sample image each have a register address that corresponds to 
the same pixel location in the ROI. Thus, for the reference image, the register address of 
the pixel location has one or more pixel values (e.g., red-color value, green-color value, 
blue-color value, etc). Similarly, the register address of the sample image has one or 

20 more pixel values. Upon selecting (610) the first pixel location, the pixel value of the 

sample image for the first pixel location is subtracted (620) from the pixel value of the 

corresponding pixel in the reference image. An embodiment of the subtraction step (620) 

is shown in greater detail with reference to FIG. 8. Alternatively, the value of the 

reference-image pixel may be subtracted from the value of the sample-pixel image. 

25 Optionally, the result of the subtraction (620) may be normalized by dividing (630) the 
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result of the subtraction (620) by the pixel value of the reference image at that pixel 
location, or by using other known normalization techniques. Since normalization 
techniques are known in the art, further discussion of such techniques is omitted here. 
The result of the calculation, whether normalized or not normalized, is then stored (640). 
5 Upon storing (640) the first result, the system determines (650) whether or not the 

contrast for all of the pixels in the ROI have been calculated. If it is determined (650) 
that all of the pixels in the ROI have been analyzed, then the process continues to the 
evaluating step (480) of FIG. 4. If, on the other hand, it is determined (650) that all of the 
pixels in the ROI have not been analyzed, then another pixel in the ROI is selected (660). 

10 Similar to the first pixel, the subsequent pixel of the reference image and the sample 
image each has register address indicative of the pixel position and a register value 
indicative of the pixel value at that register address. Once the next pixel has been 
selected (660), the process of subtracting (620), normalizing, and storing (640) is repeated 
until all pixels in the ROI have been evaluated. A contrast image for the ROI is generated 

15 upon completion of the process outlined in FIG. 6. 

As noted above, the contrast image exhibits features that facilitate defect 
detection. These features are discussed in greater detail with reference to FIG. 7. For 
example, since grapefiiiits are relatively spherical in nature, the inherent shadows cast on 
the grapefi-uit due to lighting variations may result in an overall heterogeneous 

20 appearance of the grapefruit. The heterogeneity, however, is also exhibited in the 

reference image if the reference image is similar in appearance to the normal grapefioiit. 

Thus, abnormal (e.g., defective) regions will be highlighted in the contrast image. 

FIG. 7 is a flowchart showing the evaluating step (480) of FIG. 4 in greater detail. 

Specifically, FIG. 7 describes a process for evaluating defects in spherical objects such as 

25 grapefruits, oranges, etc. However, it should be appreciated that similar methods may be 

Page 12 



TKHR 062020-1360 
GT2831 



employed for other known topologies. Since grapefruits are relatively spherical, the 
image captured by one of the cameras results in an unequal area projection of the 
grapefruit onto that image. In order to compensate for the imequal area projection, the 
ROT is unwrapped (710) to produce an equal area projection. Since spherical projections 
5 onto planar surfaces have been employed in map-making, similar techniques may also be 
employed to map the unequal area projection onto an equal area projection. In one 
example, a radial weighting function may be used in which a weight is applied to certain 
pixels as a function of its spatial position and the determined size (or radius) of the 
grapefruit in order to interpolate the equal area projection of the grapefruit surface. Since 

10 such mapping techniques are known in the art, further discussion of such techniques is 
omitted here. However, it should be appreciated that, given a priori knowledge of the 
approximate three-dimensional shape of the sample, any three-dimensional shape may be 
unwrapped (710) to produce an equal area projection. 

Once the unequal area projection has been unwrapped (710) onto an equal area 

15 projection, the system determines (720) the area of irregular pixels from the equal area 
projection. In some embodiments, this step is performed by coxmting the total number of 
pixels in the equal area projection and determining the percentage of irregular pixels. The 
irregular pixels may be defined using a nxmiber of criteria. For example, a typical 
grapefruit exhibits an orange-yellow hue. Thus, if an orange-yellow reference sphere is 

20 used to generate the contrast image, then the generated contrast image is a relatively 

homogeneous image. The reason for the relative homogeneity is because similar colors 

are subtracted between corresponding sample image pixels and reference image pixels, 

thereby effectively resulting in minimal contrast within the contrast image. Conversely, if 

a grapefruit exhibits a defect (e.g., green regions, dark scar, light scar, red regions or 

25 sunburn, etc,\ then the resulting contrast image is relatively heterogeneous because 
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different colors are subtracted between corresponding sample image pixels and reference 
image pixels. The allowable degree of heterogeneity (or variability) within the contrast 
image may be determined experimentally. In other words, sample pixels of various fruit 
classes may be accumulated and their relative clustering behavior may be observed. It 
5 should be appreciated that different samples (e.g., grapefruits, oranges, pears, or any 
natural product) may exhibit different visual defects. Hence, the system may be 
experimentally trained for each different type of sample. Since clustering algorithms are 
knovm in the art, further discussion of clustering algorithms is omitted here. However, it 
should be appreciated that, unlike prior approaches, the clustering algorithms are 

10 executed in the contrast space, thereby providing greater robustness in defect detection. 

Once the area of irregular pixels is determined (720), the system determines 
whether or not the area of irregular pixels is greater than a predefined threshold area. For 
example, in grapefruits, if a large percentage of the overall area of the grapefruit displays 
dark scar, then the grapefruit may be discarded as being defective. In this regard, not 

15 only is the qualitative contrast difference (e.g., red-color contrast, green-color contrast, 
blue-color contrast, etc.) indicative of whether a sample is defective, but the quantitative 
result (e.g, the defective area) provides an indication on whether or not the overall 
sample is defective. In order to reduce computational burdens, the predefined 
acceptability criteria, both qualitative and quantitative, may be stored in memory as 

20 lookup tables. Hence, during processing, these lookup tables may be rapidly accessed to 

efficiently determine whether or not certain pixels or certain samples are within the 

margins of acceptability. 

If the system determines (730) that the irregular area is greater than the predefined 

threshold, then the system sets (750) that sample as being defective. On the other hand, if 

25 the system determines (730) that the irregular area is not greater than the predefined 
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threshold, then the system sets (740) the sample as being an acceptable sample. In this 
regard, products exhibiting both inter-product heterogeneity and intra-product 
heterogeneity may be sorted using the above-described processes and systems. 

FIG. 8 is a flowchart showing the pixel subtraction step (620) of FIG. 6 in greater 
5 detail. As noted above, each pixel has a pixel value. For RGB images, the pixel value is 
indicative of the red value, the green value, and the blue value, which are the component 
colors of the pixel in the RGB image. In some embodiments, the red value of the 
reference pixel is subtracted (810) from the corresponding red value of the sample pixel. 
Similarly, the green value of the reference pixel is subtracted (820) from the 

10 corresponding green value of the sample pixel. Likewise, the blue value of the reference 
pixel is subtracted (830) from the blue value of the sample pixel. Thus, separate contrast 
images are generated for the red-color space, the green-color space, and the blue-color 
space. This may be advantageous, for example, in grapefruit sorting. Since healthy 
grapefruits exhibit an orange-yellow hue, the contrast images for the blue-color space and 

1 5 the green-color space may exhibit a greater dynamic range than the contrast image for the 
red-color space. Additionally, since different types of grapefixiit defects exhibit different 
color characteristics, the segregation of the different color spaces provides greater detail 
on the type of detection. These details may subsequently be used to determine the overall 
acceptability criteria of the grapefruit. 

20 While grapefruits are used to illustrate the several embodiments above, it should 

be appreciated that different food products may exhibit different color characteristics. 

Hence, defects may appear more pronounced in different color spaces for different 

products. Similarly, while natural food products are described above to illustrate several 

embodiments of the invention, it should be appreciated that similar advantages may be 

25 manifest in the analysis of synthetic products. 
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While FIGS. 1 through 3 show an example setup 100 for a three-dimensional 
product with a relatively predictable topology, FIG. 9 shows an example setup for 
acquiring relatively planar samples. For example, while a chicken breast is a three- 
dimensional sample, one surface of a de-boned chicken breast (also called a breast 
5 butterfly ) may be sufficiently approximated as a planar sample. In this regard, the setup 
of FIG. 9 may be used to generate contrast images of relatively planar samples. 

As shown in FIG. 9, several embodiments employ a single computer 905 to 
acquire and process data, rather than a computer network as shown in FIG. 2. The single 
computer 905 has an architecture that is similar to the architecture of the client computer 

10 200 of FIG. 2. In this regard, the computer 905 comprises a processor 910, memory 930, 
a network interface 950, and a hardware interface 960, which are all interconnected 
through a local bus 920. The hardware interface 960 is adapted to interface external 
components, such as a display device 970 and a camera 915, to the bus 920. The network 
interface 950 is adapted to interface the computer 905 to a network. The embodiment of 

15 FIG. 9 shows the memory 930 being configured with image acquisition logic 932, ROI 
generation logic 934, contrast image generation logic 936, lookup tables 938, and image 
evaluation logic 940. In several embodiments, these logic components 932, 934, 936, 
938, 940 may be specific computer codes that instruct the processor 910 to carry out 
functions such as image acquisition, ROI generation, contrast image generation, image 

20 evaluation, etc. As is known in the art, the memory 930 may be either volatile memory or 
non- volatile memory or a combination of both. While certain imaging applications are 
specifically shown with reference to FIG. 9, it should be appreciated that the computer 
905 may be adapted for additional fimctions, such as the execution of other software (not 
shown). 
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In operation, the camera 915 acquires an image of the sample 935 and conveys the 
image to the computer 905 for processing. Since the acquisition of images is known in 
the art, further discussion of image acquisition is omitted here. The acquired image is 
then processed by the computer 905. An example embodiment of the processing is 
5 shown in FIG. 10. 

As shown in FIG. 10, the process begins with the acquisition (1010) of the sample 
image. Upon acquiring (1010) the sample image, the sample area is determined (1020) 
from the sample image. For example, for chicken breasts, only a portion of the image is 
occupied by the sample itself. Hence, the peripheral pixels in the image represent either 

10 ^ backgroimd, noise, or both. In order to avoid evaluating those pixels, the sample is 

segregated from the remainder of the image using known techniques. For example, snake 
algorithms and threshold algorithms have produced acceptable results in which the 
sample pixels are segregated from the non-sample pixels. Since these techniques are 
known in the art, further discussion of such techniques is omitted here. It should be 

15 appreciated that, unlike the embodiments of FIGS. 4 through 8, the embodiments shown 
with reference to FIG. 10 do not separately perform an ROI analysis since the entire 
sample is the ROI. In other words, once the sample-selecting algorithm (e.g.^ snake 
algorithm, etc.) segregates the sample pixels from the non-sample pixels, those sample 
pixels constitute the ROI. 

20 Once the sample area has been determined (1020), a reference value is calculated 

(1030) from within the sample area. Hence, unlike the embodiments shown in FIGS. 4 

through 8 that use a separate reference image, the embodiments described with reference 

to FIG. 10 generate an internal reference from the sample itself. In one embodiment, the 

pixel values for the entire sample are tabulated, and the mode value of the sample pixels 

25 is selected as the reference value. However, it should be appreciated that if a majority of 
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pixels exhibit irregular appearances, then the mode value may not be the ideal reference 
value. In other embodiments, the mean value of the sample pixels is selected as the 
reference value. However, in selecting the mean value, it should be appreciated that any 
irregular pixels may contribute to a skewing of the mean value. Regardless of how the 
5 reference value is selected, it should be appreciated that the reference value is selected as 
a function of the sample itself. In this regard, inter-product heterogeneity does not 
present a significant problem since each sample has its own intemal reference value. 

Upon calculating (1030) the reference value, a contrast image is generated (1040) 
by subtracting the reference value from each pixel within the sample area. It should be 

1 0 appreciated that the multi-spectral analysis described above {e.g. , separate red-color 

space, green-color space, and blue-color space analysis) may be emplbyed in the contrast- 
image-generation step (1040) described here. The generated (1040) contrast image may 
optionally be normalized (1050) by dividing each pixel by the reference value, or by 
using other known normalization techniques. The contrast image, either normalized or 

15 not normalized, is then evaluated (1060) using similar techniques as those described 
above. 

As shown with reference to FIGS. 1 through 10, the use of contrast images in 
machine- vision-based defect detection provides greater efficiency and greater accuracy in 
inspecting and grading products. Specifically, those products exhibiting inter-product 
20 heterogeneity (or variability) as well as intra-product heterogeneity (or variability) are 
more accurately segregated using contrast-based techniques similar to those described 
above. Additionally, unlike other approaches that acquire a reference image, the 
disclosed approach acquires a reference image and further generates a contrast image 
before determining acceptance or rejection criteria for a sample. 
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In addition to the above-described approaches and systems, the reference value (or 
reference image) may be determined using a moving average of the acquired samples. 
Hence, unlike the grapefruit example, in which a reference image is acquired from a 
fabricated model, or the de-boned chicken breast example, in which an internal reference 
5 value is generated for each sample, a reference may be calculated by acquiring a moving 
average of samples. In other words, the reference value, which is stored in memory, may 
be continually updated with information obtained from each consecutive sample. Thus, 
for example, a contrast image of a sixth sample may include information obtained from 
the first five samples. Similarly, a contrast image for a seventh sample may include 

10 information obtained during the analysis of the sixth sample, etc. In this regard, the 

reference image (or reference value) for such an embodiment would include information 
obtained from previously acquired samples. The number of previously acquired samples 
may be determined on an experimental basis or, alternatively, may be selected to balance 
computational burden and processing speed. 

15 As shown here, the various techniques and approaches disclosed herein may be 

combined in a variety of permutations. Each of these permutations is intended to be 
within the scope of the invention. 

The image acquisition logic 332, the region of interest (ROI) generation logic 334, 
the contrast image generation logic 336, the image evaluation logic 340, and other related 

20 logic components of the present invention can be implemented in hardware, software, 

firmware, or a combination thereof. In the preferred embodiment(s), the image 

acquisition logic 332, the region of interest (ROI) generation logic 334, the contrast 

image generation logic 336, the image evaluation logic 340, and other related logic 

components are implemented in software or firmware that is stored in a memory and that 

25 is executed by a suitable instruction execution system. If implemented in hardware, as in 
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an alternative embodiment, the image acquisition logic 332, the region of interest (ROI) 
generation logic 334, the contrast image generation logic 336, the image evaluation logic 
340, and other related logic components can be implemented with any or a combination 
of the following technologies, which are all well known in the art: a discrete logic 
5 circuit(s) having logic gates for implementing logic functions upon data signals, an 
application specific integrated circuit (ASIC) having appropriate combinational logic 
gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), etc. 

Any process descriptions or blocks in flow charts should be understood as 
representing modules, segments, or portions of code which include one or more 

10 executable instructions for implementing specific logical functions or steps in the process, 
and altemate implementations are included within the scope of the preferred embodiment 
of the present invention in which functions may be executed out of order from that shown 
or discussed, including substantially concurrently or in reverse order, depending on the 
functionality involved, as would be understood by those reasonably skilled in the art of 

15 the present invention. 

The computer codes described above, which comprise an ordered listing of 
executable instructions for implementing logical functions, can be embodied in any 
computer-readable medium for use by or in connection with an instruction execution 
system, apparatus, or device, such as a computer-based system, processor-containing 

20 system, or other system that can fetch the instructions from the instruction execution 

system, apparatus, or device and execute the instructions. In the context of this 

document, a "computer-readable medium" can be any means that can contain, store, 

communicate, propagate, or transport the program for use by or in connection with the 

instruction execution system, apparatus, or device. The computer-readable mediimi can 

25 be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, 
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infrared, or semiconductor system, apparatus, device, or propagation medium. More 
specific examples (a nohexhaustive list) of the computer-readable medium would include 
the following: an electrical connection (electronic) having one or more wires, a portable 
computer diskette (magnetic), a random access memory (RAM) (electronic), a read-only 
5 memory (ROM) (electronic), an erasable programmable read-only memory (EPROM or 
Flash memory) (electronic), an optical fiber (optical), and a portable compact disc read- 
only memory (CDROM) (optical). Note that the computer-readable medium could even 
be paper or another suitable mediimi upon which the program is printed, as the program 
can be electronically captured, via for instance optical scanning of the paper or other 

10 medium, then compiled, interpreted or otherwise processed in a suitable manner if 
necessary, and then stored in a computer memory. 

Although exemplary embodiments have been shown and described, it will be clear 
to those of ordinary skill in the art that a number of changes, modifications, or alterations 
may be made, none of which depart from the spirit of the present invention. For example, 

15 while grapefiixits and chicken breasts have specifically been used to describe several 
embodiments of the invention, it should be appreciated that any heterogeneous product, 
either natural or synthetic, may be amenable to the approaches described above. 
Similarly, while a linear search algorithm is presented with reference to the radial Unes, it 
should be appreciated that binary search algorithms or other algorithms may be used in 

20 determining the location of the sample within the acquired image. All such changes, 

modifications, and alterations should therefore be seen as within the scope of the present 
invention. 
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